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We present a new type of deterministic dynamical behaviour that is less predictable than white 
noise. We call it anti-deterministic (AD) because time series corresponding to the dynamics of such 
systems do not generate deterministic lines in Recurrence Plots for small thresholds. We show that 
although the dynamics is chaotic in the sense of exponential divergence of nearby initial conditions 
and although some properties of AD data are similar to white noise, the AD dynamics is in fact less 
predictable than noise and hence is different from pseudo-random number generators. 
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I. INTRODUCTION 



Determinism in the strict sense is defined by the ex- 
istence of a unique solution of the initial value problem: 
Given an equation of motion, then the motion generated 
by it is said to be deterministic if the solution evolv- 
ing from a given initial condition depends exclusively on 
the latter, i.e., it is uniquely determined (for all future 
times) by fixing the initial condition 1] . This property is 
usually contrasted by stochastic motion, where random 
noises enter the equation of motion, such that the initial 
condition alone is insufficient to fix the future evolution. 
One additionally needs to know the realization of the se- 
quence of noise inputs. Without this, one can only make 
probabilistic statements about the evolving solutions. 

In the above restricted sense, the dynamics which we 
introduce here is in fact deterministic. However, when 
speaking about determinism, one often considers the as- 
pect of recurrence: Determinism implies that when, in 
the course of time, the system returns to a state which 
it has assumed before, the evolution will repeat itself 
precisely. If in addition (as it is most often the case) 
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the terms in the equation of motion depend smoothly on 
the state vector, then the return to a similar state will 
cause a similar future evolution, at least on short times 
(in chaotic systems, this time is related to the inverse 
of the Kolmogorov-Sinai entropy). This follows from a 
simple linearization of the equations around a given ref- 
erence state and is the basis of many time series tools 
in reconstructed phase spaces'^. In particular, this is 
the basis of the famous "Lorenz method of analogues" 
or, more technically speaking, the zeroth order predic- 
tion scheme Pj: If one wants to predict the short time 
future of a deterministic system, the simplest method is 
to look for situations in the past which are very simi- 
lar to the present one, and to assume that (because of 
the above discussed properties of determinism) the fu- 
ture will be similar to what followed the similar situation 
in the past. In many applications to experimental data, 
such prediction schemes have in fact been proven to work 
very successfully 0, l^. What we call anti-deterministic 
is exactly the opposite: whenever our system comes to 
a state which is similar to some state of the past, it will 
evolve in the most different way from the past, so that 
past information is systematically misleading when try- 
ing to make predictions. 

This property would require a highly non-smooth equa- 
tion of motion. Instead, we will define the dynamics not 
through an equation of motion but by a minimization 
problem. This is, however, not too unusual, since one 
can convert every differential equation initial value prob- 
lem into a variational problem, where the solution on a 
finite time interval is given by a path which generates the 
extremum of some functional (compare the principle of 
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minimal action in classical mechanics 'oj). 

A particular tool for the visual inspection of this as- 
pect of determinism is the recurrence plot0. A recur- 
rence plot of a given time series {xi} , i = 1, . . . , is the 



N X A^-matrix R with the entries Ri 



e(£- 



where Q is the Heaviside step function. I.e., a matrix el- 
ement is unity if the correponding time series points are 
closer than e, and it is zero else. Such a matrix can be 
easily represented graphically which is called the recur- 
rence plot, with the parameter e. Several concepts for 
a quantitative evaluation of recurrence plots have been 
proposed|l|i[l3. 

Based on the theorem of Takens[l]|. determinism in 
the more general sense expresses itself in time series data 
by the existence of line segments parallel to the diago- 
nal in this plot. The lengths of these lines for periodic 
or quasiperiodic systems are limited only by the lengths 
A' of the corresponding time series because there is no 
divergence of nearby trajectories. The lines are much 
shorter for chaotic motion because of a finite exponen- 
tial divergence, corresponding to the positive entropy of 
chaotic systems 3. The lines themselves are represen- 
tative of unstable periodic orbits of the system. Also 
for data stemming from uncorrelated stochastic processes 
(such as white noise) there exists some small but nonzero 
probability that a "deterministic" line can occur in a RP 
for a finite threshold value e, since similar data segments 
may occur by chance. The systems which we call anti- 
deterministic (AD) are designed to create systematically 
less lines parallel to the diagonal in recurrence plots than 
white noise, and for certain recurrence parameters they 
do not possess any line at all. 

More specifically, we generate sequences of AD data 
by requiring them not to create any line of length longer 
then n in RP maximizing the threshold e. We found 
several algorithms that can produce such data in a de- 
terministic way, and presumably one can also introduce 
some randomness beyond the choice of random initial 
conditions. In the next section we show one simple pro- 
cedure. The AD motion does not belong to a class of 
chaotic systems with a very high entropy (pseudo-random 
number generators [T^). As it will become clear in the 
next section, our construction of AD data requires an 
infinite memory of the dynamical system, which corre- 
sponds to an infinite dimensional phase space. There are 
neither (unstable) periodic orbits nor is there any attrac- 
tor. Data corresponding to AD systems cover uniformly 
the whole admissible phase space. 



II. A SIMPLE ALGORITHM FOR AD DATA 
GENERATION 

Working in discrete time, we generate the AD data it- 
eratively. We restrict the individual time series elements 
Xi to be from the unit interval, Xi G [0, 1] Vi. Let {xt} 
for i = l,2,...,A'^bea given sequence representing the 
data up to time N. The next time series element xjv+i 
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FIG. 1: The example of AD time series. 



is the one that maximizes its (suitably defined) distance 
to all previous points of the time series. More precisely, 
xn+1 maximizes the following utility function Ux- 



Ux = min 

i—d-\-m,d+m+l, 



Y[ disd {i — K, N + 1 — k) 



(1) 

Here, m and d are parameters of the algorithm, while 
disd {i, N -\- 1) is the Euclidean distance between points 
Xi and xn+1 in a d-dimensional time delay embedding 
space: 



disd{i,N + 1) 



E 

fc=0 



\\Xl-k - XN+l-k\\ 



(2) 



It can be useful to impose periodic boundary conditions 
on the unit interval when computing the distance, i.e., 
\\xi - XjW := min{\xi - Xj\,l-\xi - Xj\). 

For the simple choice m = 0, Eq.(l) gives the distance 
(in the d-dimensional time delay embedding space) be- 
tween the "new" time series point and its closest neigh- 
bour among all past points, which, by the choice of the 
new point, should be as large as possible. For m > 0, the 
antideterministic features which we study below become 
more pronounced. In order to start the algorithm, an 
initial sequence {xi} for z = 1, 2, . . . , tiq has to be chosen. 

Our algorithm of AD data generation is very simple 
and one can imagine that this method can be modified 
in many different ways, e.g., by modifying the function 
Ux- As long as the main idea, namely that the new data 
point (in a time delay embedding sense of Takens0) IS 
required to be far from all previous points, is respected 
by Ux, the properties of the resulting data are all very 
similar. In Fig. ^ an example of an AD time series is 
shown. 
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FIG. 2; The distance of time series elements As = \\xj — 
evolving from nearby initial conditions (no = 50, m = 4, 
2, perturbation of the initial condition in the range of 10~ 
The line guides the eye and corresponds to the behavior e" 
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III. PROPERTIES 

The requirement of anti-determinism translates into 
the fact that there cannot be contracting and not even 
marginally stable directions jisj in the dynamical system. 
This type of behavior easily occurs in discrete time where 
all directions can be divergent. In a conventional flow 
(continuous time system) there is always one direction 
corresponding to a zero Lyapunov exponent. Hence, if 
the generalization of AD to continuous time dynamics is 
possible it will lead to a nowhere continuous signal sim- 
ilar to white noise. Here, we restrict ourselves to the 
time discrete version. An AD trajectory never forgets 
its initial condition {xi}, i = 1, 2, . . . , no and it is very 
sensitive to their changes. As we can see from Fig|21 the 
divergence of initially nearby solutions is, on average, ex- 
ponential, resembling low-dimensional chaos. This result 
is consistent with our statement that AD data are usually 
no high-entropic data such as those generated by linear 
congruential random number generators. The specific 
realization also depends sensitively on the parameters m 
and d. The main feature of AD data is the absence of RP 
lines of lengths larger than d for small values of e. In a 
conventional chaotic sequence, despite the unpredictabil- 
ity in the long run, on short times similar states evolve 
similarly. This is related to the existence of unstable pe- 
riodic orbits which are densely embedded in the invariant 
set for relevant classes of chaotic attractors^^. A close 
approach of the trajectory to an unstable periodic orbit 
can create a long line in the recurrence plot. Our algo- 
rithm sytematically eliminates the possibility of unstable 
periodic orbits, as one can easily see: A periodic time 
series, of whatever large period length T, would result in 
U{xn+i) = in Eq.(l) as soon as + 1 > T, hence, the 
periodic continuation is forbidden by our algorithm. 

An AD system tries not only not to repeat the past tra- 



jectory but to escape from it to other points of the phase 
space. It follows that although for chaotic systems the 
attractor dimension is finite and fixed for the AD mo- 
tion the dimension of an observed trajectory increases 
with the number of generated points. In this sense the 
AD systems are infinite dimensional and Unstable Peri- 
odic Orbits cannot exist. Neigbouring trajectories in AD 
systems diverge in all directions and as result there is 
no system attractor, i.e., the data are confined to a fi- 
nite volume in space only through the constraints (here: 
Xi e [-0.5 : 0.5]). 



IV. TIME SERIES ANALYSIS 

The AD data share many properties of white noise, 
but there are some which do not appear in any another 
dynamical behaviour. Let us first focus on features com- 
mon with noisy data. It is easy to check that our AD data 
converge to the uniform density in the unit interval. The 
autocorrelation function, the mutual information param- 
eter as well as the power spectrum are for the AD data 
of Eq.(l) the same as for the white noise, i.e., AD data 
appear to be uncorrelated. 

Of course, by construction, there are subtle long range 
correlations which have to show up in a suitable analysis. 
The block correlation entropies K2 offer one such anal- 
ysis. In terms of RP a line of length 1 in an embedding 
dimension n and a line of length n in an embedding di- 
mension 1 are equivalent ;15i] . For this reason one can 
alternatively use terms embedding dimension and length 
of a line (the embedding dimension used in RP is one for 
all the calculations). Let us define the number of lines 
in RP of length n or longer as DETn{e) ji^. Then the 
coarse-grained block correlation entropy can be defined 
as [13 



K^{e) = In 



DET^je) 
DETn+i{e) 



(3) 



and it corresponds to the slope in the plot InDETn ver- 
sus n. The differences between the noise and AD data 
can be seen very clearly when we plot the coarse-grained 
block correlation entropy ifj" versus the embedding di- 
mension n (see Fig. . The entropy of AD data mea- 
sured from numbers DETn{e) of lines of length n ~ 2> 
or longer is higher than the white noise entropy which in 
Fig.^is a straight line with the slope — In(lO). The min- 
imal threshold for which the entropy can be calculated 
for n = 3 corresponds to the maximal Smax for which 
there are no lines in RP of the length n = 3 or longer. 
The maximal entropies which can be obtained from a fi- 
nite time series of white noise and of the AD time series 
of the same length are the same, but the maximum for 
AD data is always reached with larger values of Emax as 
compared to noisy data. 

The same feature of AD data can be analyzed from 
another point of view. We have calculated the minimal 
distance between nearest neighbors for the whole data 
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FIG. 3: Coarse-grained block correlation entropy calculated 
for AD systems with d = 2, m = 4. Curves from the left 
to right correspond to embedding dimensions increasing from 
n = 2 to n = 7 while the straight line corresponds to entropy 
of white noise. The inset shows schematically the behaviour 
of the coarse-grained correlation entropy for different types 
of motion: (dashed dotted line) deterministic systems (D), 
(dashed line) white noise (WN) and (solid line) AD. 



set and have divided it by the same quantity of shuffled 
data. Because for random data the minimal distance 
between nearest neighbors can differ for different shuffling 
an appropriate averaging has been performed. In such a 
way we create a parameter that we call ADETn which 
is a measure how much data are anti-deterministic (n 
is here an embedding dimension). We have checked that 
for chaotic data with noise and for large n this parameter 
converges to the noise level 



NTS = 



<7DATA 



(4) 



where Unoise is the standard deviation of noise and 
CD ATA stands for the standard deviation of data. Hence, 
for (noisy) deterministic data it is usually much smaller 
than unity. Shuffling makes no difference for random 
data and hence ADETn ~ 1- Fig- ^ shows a plot of 
values ADETn versus n for AD data with d — 2 and 
m = 4. One can see that for n between 4 and 7 we have 
ADETn ~ 1.75 what means that the mean minimal dis- 
tance between nearest neighbors for AD data is about 1.7 
times larger than for noisy data, and very much larger 
than for conventional deterministic data. 

To demonstrate that AD data are less predictable than 
noise we have calculated a prediction error that one re- 
ceives from a zeroth order prediction j^] using the nearest 
neighbor. This simple forecasting method shows clearly 
that our AD data are less predictable than noise, i.e., 
than randomly shuffled data (see Fig. (S)). The average 
prediction error for noisy data should equal because 
we have the root mean square of a quantity which is the 
sum of two random numbers, and the error of our AD 
data is larger for a range of embedding dimensions. 

Long range correlations in data may also express them- 
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FIG. 4: The plot of parameter ADETn versus n (d = 2 and 
m = 4). 
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FIG. 5: The prediction error divided by standard deviation 
of data for AD data (d = 2, m = 4) and for randomly shuffled 
data. 



selves in anomalous diffusion properties when integrating 
the data[l8|. This can be quantified by the Hurst expo- 
nent. The Hurst exponent of data generated by Eq.(l) 
is found to be 1/2, which is the value of white noise. 
However, using a different, more complicated algorithm 
(see appendix IXjl. we were able to create data which are 
anti-persistent, i.e., for which we found Hurst exponents 
ranging from 0.15 to 0.5, depending on parameters in the 
algorithm. Observing histograms of such data we have 
found that for finite time series lengths, the data can be 
much more uniformly distributed than for standard noise 
generators (used commonly in C compilers). Thanks to 
this property one can generate very short time series with 
a very flat histogram. 
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APPLICATIONS 
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There may be different useful applications of AD data. 
One of them are noise generators. Common features of 
AD data and noisy data are in this case very desired. 
Some of the properties can be modified changing the 
method and its parameters, e.g., to get a desired anti- 
persistence. The big advantage here might be given by 
the property that histograms converge much faster to 
their limiting shape than for uncorrelated random num- 
bers, so that smaller samples might yield sample means 
which are closer to the true mean than for truly random 
samples. In Monte Carlo methods for searching global 
minima, the feature of having large minimal distances 
might enhance the efficiency due to the fact that it is 
less likely to converge to the same local minimum with 
another initial condition from the sample. 

The AD systems can also be used in data encryption 
because noisy behavior makes unwanted deciphering very 
difficult. As we mentioned, there are many ways of how 
to modify the method generating AD data which can pro- 
duce entirely different time series. One can imagine that 
an encryption key can be parameters of a modificated 
scheme. 

We suspect that AD behaviour can be observed in na- 
ture as well. One evident possibility is to see it as results 
of games when an intelligent player tries to find a strategy 
that would be as much as possible unpredictable to an 
intelligent opponent. This can occur in predator-prey re- 
lations as well as in economical processes. In physics, 
adding one by one charged particles to a set of fixed 
charges with the requirement of consuming minimal en- 
ergy would result in a sequence of positions of the added 
particles which is generated by a functional similar to 

Eq.(l), = (j2iLi b^-ZTT-J ) ' but working in a, 



-xn + i\ 



say, 2-dimensional space. 



APPENDIX A: ANOTHER ALGORITHM FOR 
AD DATA GENERATION 



For each i — 1,2, . . . , N —1 we calculate in dimension d 
the square of the Euclidean distance disd {i, N) between 
the point Xi and xn- 



d-l 

disd{i,N) = ^ {xi-k 

k=0 



XN-k) 



(Al) 



Then we determine the following parameter Pk created 
from the above distances 



max 

d—K,K-\-l,. 



id)" 



k [ disd (k, N) 



(A2) 



Here k and q are the parameters of the method, and 
the maximum over d is usually obtained for d not much 
bigger than k. Now we have to discretize the domain of 
the set {xi} on S intervals {zk} for k = 1,2, ... ,S, so 
we have Zk = {mirix + (fc — l)Ax,minx + kAx] where 
_ max^-min^ ^ HeiB maXx is the maximal value from 
the set {xi\ and mirix is the minimal value respectively. 
Next for each interval zu we calculate the utility function 
Uk as follows 



N 



Uk^Y.p^ 



9b 



N- 



Xi — mirix 



maxx 



(A3) 



In our case we use the hyperbolic function 



VI. CONCLUSIONS 
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We present a new type of system behavior that is nei- 
ther periodic, nor quasiperiodic, chaotic or stochastic in a 
conventional sense. This kind of motion violates the main 
feature of common deterministic systems, i.e., occurrence 
of lines parallel to the main diagonal in recurrence plots. 
We call this kind of motion anti-deterministic. AD sys- 
tems have many common features with white noise. Non- 
linear time series analysis reveals that anti-determinism 
is related to a divergent behaviour of block correlation 
entropies computed on finite data set, which is consis- 
tent with the observation that they are less predictable 
than white noise. 
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for 6 > 0. h appears as the parameter of the method. 
The last step is to look for the index at the minimal 



utility function m 



belonging to the interval z^. 
solution as follows 



k : min{t/fc} j and create variable 
We determine the exact 




Um+l < Ur, 

otherwise. 



(A5) 



After we found the value of xn+i we repeat the whole 
procedure for the larger set {xi} where i — 1,2, ... , N + 1 
and so on. Main differences of this algorithm for AD data 
generation to the previous one is that we use a range of 
dimensions d in Eq. (|A2p and a global influence of every 
point i to the utility function (|A3|) . 
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